Identifying regions of free space within an image

ABSTRACT

A digital magazine server presents content, which may include images, retrieved from various sources to a user. To improve presentation of images while allowing modification of images, the digital magazine server identifies feature points in an image and identifies regions of the image including the feature points. Groups of regions are generated based at least on the number of feature points in each region and the location of each region. Based on information associated with the groups, such as the location of various groups and the aspect ratio of various groups, one or more groups are selected and associated with the image. The selected groups may identify regions of the image including an object or not including an object, providing information for modifying the image without obscuring objects in the image.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of U.S. Provisional PatentApplication No. 61/933,625, filed on Jan. 30, 2014, which isincorporated by reference herein in its entirety.

BACKGROUND

This invention generally relates to analyzing images, and morespecifically to identifying regions of an image free of objects prior topresentation to a user.

A digital magazine server provides digital content to its users as adigital magazine including various pages that each include content itemsarranged in positions relative to each other. Frequently, digitalcontent provided to digital magazine server users includes images. Toincrease the number of content items presented in a page of the digitalmagazine, the digital magazine server often includes text providingadditional information about an image in the image itself. However,conventional methods of including text in an image often result in thetext being illegible or obscuring objects in the image likely to be ofinterest to a user.

Additionally, the digital magazine server may crop images to reduce thesize of images presented to users by removing portions of the image.However, conventional methods of cropping images often crop objects inthe image, reducing the information conveyed to a user by the image. Forexample conventional image cropping methods merely remove portions of animage based on image size, regardless of the content in differentportions of the image.

SUMMARY

A digital magazine server retrieves content from one or more sources andgenerates a personalized, customizable digital magazine for a user basedon the retrieved content. The digital magazine server organizes contentitems having at least one common characteristic into various sectionsbased on page templates describing the relative positioning of contentitems to each other. Content items are presented to the user accordingto the sections.

The retrieved content items may be associated with images or includeimages, and the digital magazine server selects and/or modifies imagesfor presentation to the user. For example, the digital magazine serveridentifies regions of an image including one or more objects. In oneexample, the digital magazine server identifies one or more featurepoints in an image. A feature point identifies a point of interestassociated with an object in the image. For example, a feature pointidentifies a point in the image with at least a threshold change incolor. The digital magazine server partitions the image into one or moreregions and determines a number of feature points included in eachregion. Based at least in part on the number of feature points includedin each region, the digital magazine server generates groups includingone or more regions of the image.

One or more groups of regions are identified based at least in part onthe number of feature points in each group. For example, groupsincluding less than a threshold number of feature points are identifiedto indicate portions of the image in which text may be presented withoutobstructing objects in the image. As another example, groups includinggreater than a threshold number of feature points are identified toindicate portions of the image including content not to be cropped. Inone embodiment, the groups are ranked based at least in part on theaspect ratio of the groups, the size of the groups, or another suitablecharacteristic of the groups, with groups identified based at least inpart on the ranking. For example, groups with a higher position in theranking are identified as portions of the image capable of includingtext or being cropped. Information describing the identified groups isstored in association with the image and may be communicated to a clientdevice along with the image for modification of the image when it ispresented.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a system environment in which a digitalmagazine server operates, in accordance with an embodiment of theinvention.

FIG. 2 is a block diagram of a digital magazine server, in accordancewith an embodiment of the invention.

FIG. 3 is an example of presentation of content items in a digitalmagazine using a page template, in accordance with an embodiment of theinvention.

FIG. 4 shows a flowchart of a method for identifying regions in an imagebased on feature points included in the image, in accordance with anembodiment of the invention.

FIGS. 5a-5e illustrate an example of identifying, grouping and selectingregions of an image, in accordance with an embodiment of the invention.

The figures depict various embodiments of the present invention forpurposes of illustration only. One skilled in the art will readilyrecognize from the following discussion that alternative embodiments ofthe structures and methods illustrated herein may be employed withoutdeparting from the principles of the invention described herein.

DETAILED DESCRIPTION

Overview

A digital magazine server retrieves content from one or more sources andgenerates a personalized, customizable digital magazine for a user basedon the retrieved content. The generated digital magazine is retrieved bya digital magazine application executing on a computing device (such asa mobile communication device, tablet, computer, or any other suitablecomputing system) and presented to the user. For example, based onselections made by the user and/or on behalf of the user, the digitalserver application generates a digital magazine including one or moresections including content items retrieved from a number of sources andpersonalized for the user. The generated digital magazine allows theuser to more easily consume content that interests and inspires the userby presenting content items in an easily navigable interface via acomputing device.

The digital magazine may be organized into a number of sections thateach include content having a common characteristic (e.g., contentobtained from a particular source). For example, a section of thedigital magazine includes articles from an online news source (such as awebsite for a news organization), another section includes articles froma third-party-curated collection of content associated with a particulartopic (e.g., a technology compilation), and an additional sectionincludes content obtained from one or more accounts associated with theuser and maintained by one or more social networking systems. Forpurposes of illustration, content included in a section is referred toherein as “content items” or “articles,” which may include textualarticles, pictures, videos, products for sale, user-generated content(e.g., content posted on a social networking system), advertisements,and any other types of content capable of display within the context ofa digital magazine.

System Architecture

FIG. 1 is a block diagram of a system environment 100 for a digitalmagazine server 140. The system environment 100 shown by FIG. 1comprises one or more sources 110, a network 120, a client device 130,and the digital magazine server 140. In alternative configurations,different and/or additional components may be included in the systemenvironment 100. The embodiments described herein can be adapted toonline systems that are not digital magazine severs 140.

A source 110 is a computing system capable of providing various types ofcontent to a client device 130. Examples of content provided by a source110 include text, images, video, or audio on web pages, web feeds,social networking information, messages, or other suitable data.Additional examples of content include user-generated content such asblogs, tweets, shared images, video or audio, social networking posts,and social networking status updates. Content provided by a source 110may be received from a publisher (e.g., stories about news events,product information, entertainment, or educational material) anddistributed by the source 110, or a source 110 may be a publisher ofcontent it generates. For convenience, content from a source, regardlessof its composition, may be referred to herein as an “article,” as a“content item,” or as “content.” A content item may include varioustypes of content, such as text, images, and video.

The sources 110 communicate with the client device 130 and the digitalmagazine server 140 via the network 120, which may comprise anycombination of local area and/or wide area networks, using both wiredand/or wireless communication systems. In one embodiment, the network120 uses standard communications technologies and/or protocols. Forexample, the network 120 includes communication links using technologiessuch as Ethernet, 802.11, worldwide interoperability for microwaveaccess (WiMAX), 3G, 4G, code division multiple access (CDMA), digitalsubscriber line (DSL), etc. Examples of networking protocols used forcommunicating via the network 120 include multiprotocol label switching(MPLS), transmission control protocol/Internet protocol (TCP/IP),hypertext transport protocol (HTTP), simple mail transfer protocol(SMTP), and file transfer protocol (FTP). Data exchanged over thenetwork 120 may be represented using any suitable format, such ashypertext markup language (HTML) or extensible markup language (XML). Insome embodiments, all or some of the communication links of the network120 may be encrypted using any suitable technique or techniques.

The client device 130 is one or more computing devices capable ofreceiving user input as well as transmitting and/or receiving data viathe network 120. In one embodiment, the client device 130 is aconventional computer system, such as a desktop or a laptop computer.Alternatively, the client device 130 may be a device having computerfunctionality, such as a personal digital assistant (PDA), a mobiletelephone, a smartphone or another suitable device. In one embodiment,the client device 130 executes an application allowing a user of theclient device 110 to interact with the digital magazine server 140. Forexample, an application executing on the client device 130 communicatesinstructions or requests for content items to the digital magazineserver 140 to modify content presented to a user of the client device130. As another example, the client device 130 executes a browser thatreceives pages from the digital magazine server 140 and presents thepages to a user of the client device 130. In another embodiment, theclient device 130 interacts with the digital magazine server 140 throughan application programming interface (API) running on a native operatingsystem of the client device 110, such as IOS® or ANDROID™. While FIG. 1shows a single client device 130, in various embodiments, any number ofclient devices 130 may communicate with the digital magazine server 140.

A display device 132 included in the client device 130 presents contentitems to a user of the client device 130. Examples of the display device132 include a liquid crystal display (LCD), an organic light emittingdiode (OLED) display, an active matrix liquid crystal display (AMLCD),or any other suitable device. Different client devices 130 may havedisplay devices 132 with different characteristics. For example,different client devices 132 have display devices 132 with differentdisplay areas, different resolutions, or differences in othercharacteristics.

One or more input devices 134 included in the client device 130 receiveinput from the user. Different input devices 134 may be included in theclient device 130. For example, the client device 130 includes atouch-sensitive display for receiving input data, commands, orinformation from a user. Using a touch-sensitive display allows theclient device 130 to combine the display device 132 and an input device134, simplifying user interaction with presented content items. In otherembodiments, the client device 130 may include a keyboard, a trackpad, amouse, or any other device capable of receiving input from a user. Inanother example, the input device 134 is configured to receiveinformation from a user of the client device through a touchlessinterface. Examples of a touchless interface include sensors, such as animage capture device, to receive gestures from a client device userwithout the user physically contacting the display device 132 or theclient device 130. Additionally, the client device 130 may includemultiple input devices 134 in some embodiments. Inputs received via theinput device 134 may be processed by a digital magazine applicationassociated with the digital magazine server 140 and executing on theclient device 130 to allow a client device user to interact with contentitems presented by the digital magazine server 140.

The digital magazine server 140 receives content items from one or moresources 110, generates pages in a digital magazine by processing thereceived content, and provides the pages to the client device 130. Asfurther described below in conjunction with FIG. 2, the digital magazineserver 140 generates one or more pages for presentation to a user basedon content items obtained from one or more sources 110 and informationdescribing organization and presentation of content items. For example,the digital magazine server 140 determines a page layout specifyingpositioning of content items relative to each other based on informationassociated with a user and generates a page including the content itemsarranged according to the determined layout for presentation to the uservia the client device 130. This allows the user to access content itemsvia the client device 130 in a format that enhances the user'sinteraction with and consumption of the content items. For example, thedigital magazine server 140 provides a user with content items in aformat similar to the format used by print magazines. By presentingcontent items in a format similar to a print magazine, the digitalmagazine server 140 allows a user to interact with content items frommultiple sources 110 via the client device 130 with less inconveniencefrom horizontally or vertically scrolling to access various contentitems.

FIG. 2 is a block diagram of an architecture of the digital magazineserver 140. The digital magazine server 140 shown in FIG. 2 includes auser profile store 205, a template store 210, a content store 215, alayout engine 220, a connection generator 225, a connection store 230, arecommendation engine 235, a search module 240, an interface generator245, and a web server 250. In other embodiments, the digital magazineserver 140 may include additional, fewer, or different components forvarious applications. Conventional components such as networkinterfaces, security functions, load balancers, failover servers,management and network operations consoles, and the like are not shownso as to not obscure the details of the system architecture.

Each user of the digital magazine server 140 is associated with a userprofile, which is stored in the user profile store 205. A user profileincludes declarative information about the user that was explicitlyshared by the user and may also include profile information inferred bythe digital magazine server 140. In one embodiment, a user profileincludes multiple data fields, each describing one or more attributes ofthe corresponding social networking system user. Examples of informationstored in a user profile include biographic, demographic, and othertypes of descriptive information, such as gender, hobbies orpreferences, location, or other suitable information. A user profile inthe user profile store 205 also includes data describing interactions bya corresponding user with content items presented by the digitalmagazine server 140. For example, a user profile includes a content itemidentifier, a description of an interaction with the content itemcorresponding to the content item identifier, and a time when theinteraction occurred.

While user profiles in the user profile store 205 are frequentlyassociated with individuals, allowing individuals to provide and receivecontent items via the digital magazine server 140, user profiles mayalso be stored for entities such as businesses or organizations. Thisallows an entity to provide or access content items via the digitalmagazine server 140. An entity may post information about itself, aboutits products or provide other content items associated with the entityto users of the digital magazine server 140. For example, users of thedigital magazine server 140 may receive a digital magazine or sectionincluding content items associated with an entity via the digitalmagazine server 140.

The template store 210 includes page templates each describing a spatialarrangement (“layout”) of content items relative to each other on a pagefor presentation by a client device 130. A page template includes one ormore slots, each configured to present one or more content items. Insome embodiments, slots in a page template may be configured to presenta particular type of content item or to present a content item havingone or more specified characteristics. For example, a slot in a pagetemplate is configured to present an image while another slot in thepage template is configured to present text data. Each slot has a size(e.g., small, medium, or large) and an aspect ratio. One or more pagetemplates may be associated with types of client devices 130, allowingcontent items to be presented in different relative locations and withdifferent sizes when the content items are viewed using different clientdevices 130. Additionally, page templates may be associated with sources110, allowing a source 110 to specify the format of pages presentingcontent items received from the source 110. For example, an onlineretailer is associated with a page template to allow the online retailerto present content items via the digital magazine server 140 with aspecific organization. Examples of page templates are further describedin U.S. patent application Ser. No. 13/187,840, filed on Jul. 21, 2011,and in U.S. patent application Ser. No. 13/938,223, filed on Jul. 9,2013, each of which is hereby incorporated by reference in its entirety.

The content store 215 stores objects that each represent various typesof content. For example, the content store 215 stores content itemsreceived from one or more sources 115 within a threshold time of acurrent time. Examples of content items stored by the content store 215include a page post, a status update, a photograph, a video, a link, anarticle, video data, audio data, a check-in event at a location, or anyother type of content. A user may specify a section including contentitems having a common characteristic, and the common characteristic isstored in the content 215 store along with an association with the userprofile or the user specifying the section.

The layout engine 220 retrieves content items from one or more sources110 or from the content store 215 and generates a page including thecontent items based on a page template from the template store 210.Based on the retrieved content items, the layout engine 220 may identifycandidate page templates from the template store 210, score thecandidate page templates based on characteristics of the slots indifferent candidate page templates and based on characteristics of thecontent items. Based on the scores associated with candidate pagetemplates, the layout engine 220 selects a page template and associatesthe retrieved content items with one or more slots to generate a pagewhere the retrieved content items are presented relative to each otherand sized based on their associated slots. When associating a contentitem with a slot, the layout engine 220 may associate the content itemwith a slot configured to present a specific type of content item or topresent content items having one or more specified characteristics. Anexample of using a page template to present content items is furtherdescribed in U.S. patent application Ser. No. 13/187,840, filed on Jul.21, 2011, and in U.S. patent application Ser. No. 13/938,226, filed onJul. 9, 2013, each of which is hereby incorporated by reference in itsentirety.

In some embodiments, the layout engine 220 identifies regions of animage retrieved from the content store 215 or from one or more sources110, that do not include an object. Alternatively, the layout engine 220may identify regions of a retrieved image that include an object. Asfurther described below in conjunction with FIG. 4, the layout engine220 identifies feature points in the image and identifies groups ofregions of the image based on the number of feature points in variousregions. The feature points in an image are associated with one or morepoints of interest associated with an object. One or more groups areselected based on a number of feature points included in various groups.For example, the groups of regions are ranked based at least in part onthe number of feature points in each group, and one or more groups areselected based on the ranking. Information identifying positions of theselected groups within the image is associated with the image. The imagemay then be modified based on the selected groups. For example, text isincluded in the image in positions of the image associated with one ormore selected groups of regions if the groups are selected based onhaving less than a threshold number of feature points. This allows theimage to be modified to include text in one or more of the groups ofregions, and the modified image is presented to a user of the digitalmagazine server 140, allowing additional information to be presentedalong with the image while increasing the amount of display areaavailable to display additional content items. Alternatively, the imagemay be modified by cropping portions of the image associated withselected groups if the groups are selected based on including at least athreshold number of feature points. This allows the image size to bereduced without removing certain objects of the image.

The connection generator 225 monitors interactions between users andcontent items presented by the digital magazine server 140. Based on theinteractions, the connection generator 225 determines connectionsbetween various content items, connections between users and contentitems, or connections between users of the digital magazine server 140.For example, the connection generator 225 identifies when users of thedigital magazine server 140 provide feedback about a content item,access a content item, share a content item with other users, or performother actions with content items. In some embodiments, the connectiongenerator 225 retrieves data describing user interaction with contentitems from the user's user profile in the user profile store 205.Alternatively, user interactions with content items are communicated tothe connection generator 225 when the interactions are received by thedigital magazine server 140. The connection generator 225 may accountfor temporal information associated with user interactions with contentitems. For example, the connection generator 225 identifies userinteractions with a content item within a specified time interval orapplies a decay factor to identified user interactions based on timesassociated with interactions. The connection generator 225 generates aconnection between a user and a content item if the user's interactionswith the content item satisfy one or more criteria. In one embodiment,the connection generator 225 determines one or more weights specifying astrength of the connection between the user and the content item basedon user interactions with the content item that satisfy one or morecriteria. Generation of connections between a user and a content item isfurther described in U.S. patent application Ser. No. 13/905,016, filedon May 29, 2013, which is hereby incorporated by reference in itsentirety.

If multiple content items are connected to a user, the connectiongenerator 225 establishes implicit connections between each of thecontent items connected to the user. In one embodiment, the connectiongenerator 225 maintains a user content graph identifying the implicitconnections between content items connected to a user. In oneembodiment, weights associated with connections between a user andcontent items are used to determine weights associated with variousimplicit connections between content items. User content graphs formultiple users of the digital magazine server 140 are combined togenerate a global content graph describing connections between variouscontent items provided by the digital magazine server 140 based on userinteractions with various content items. For example, the global contentgraph is generated by combining user content graphs based on mutualconnections between various content items in user content graphs.

In one embodiment, the connection generator 225 generates an adjacencymatrix from the global content graph or from multiple user contentgraphs and stores the adjacency matrix in the connection store 230. Theadjacency matrix describes connections between content items. Forexample, the adjacency matrix includes identifiers of content items andweights representing the strength or closeness of connections betweencontent items based on the global content graph. As an example, theweights indicate a degree of similarity in subject matter or similarityof other characteristics associated with various content items. In otherembodiments, the connection store 230 includes various adjacencymatrices determined from various user content graphs; the adjacencymatrices may be analyzed to generate an overall adjacency matrix forcontent items provided by the digital magazine server 140. Graphanalysis techniques may be applied to the adjacency matrix to rankcontent items, to recommend content items to a user, or to otherwiseanalyze relationships between content items. An example of the adjacencymatrix is further described in U.S. patent application Ser. No.13/905,016, filed on May 29, 2013, which is hereby incorporated byreference in its entirety.

In addition to identifying connections between content items, theconnection generator 225 may also determine a social proximity betweenusers of the digital magazine server 140 based on interactions betweenusers and content items. The digital magazine server 140 determinessocial proximity, or “social distance,” between users using a variety oftechniques. For example, the digital magazine server 140 analyzesadditional users connected to each of two users of the digital magazineserver 140 within a social networking system to determine the socialproximity of the two users. In another example, the digital magazineserver 140 determines social proximity between a first and a second userby analyzing the first user's interactions with content items posted bythe second user, whether the content item is posted using the digitalmagazine server 140 or on another social networking system. Additionalexamples for determining social proximity between users of the digitalmagazine server 140 are described in U.S. patent application Ser. No.13/905,016, filed on May 29, 2013, which is incorporated by reference inits entirety. In one embodiment, the connection generator 225 determinesa connection confidence value between a user and an additional user ofthe digital magazine server 140 based on the user's and the additionaluser's common interactions with particular content items. The connectionconfidence value may be a numerical score representing a measure ofcloseness between the user and the additional user. For example, alarger connection confidence value indicates a greater similaritybetween the user and the additional user. In one embodiment, if a userhas at least a threshold connection confidence value with another user,the digital magazine server 140 stores a connection between the user andthe additional user in the connection store 230.

Using data from the connection store 230, the recommendation engine 235identifies content items from one or more sources 110 for recommendingto a digital magazine server user. Hence, the recommendation engine 235identifies content items potentially relevant to a user. In oneembodiment, the recommendation engine 235 retrieves data describinginteractions between a user and content items from the user's userprofile and data describing connections between content items, and/orconnections between users from the connection store 230. In oneembodiment, the recommendation engine 235 uses stored informationdescribing content items (e.g., topic, sections, subsections) andinteractions between users and various content items (e.g., views,shares, saved, links, topics read, or recent activities) to identifycontent items that may be relevant to a digital magazine server user.For example, content items having an implicit connection of at least athreshold weight to a content item with which the user interacted arerecommended to the user. As another example, a the recommendation engine235 presents a user with content items having one or more attributes incommon with a content item with which an additional user having athreshold connection confidence score with the user interacted.Recommendations for additional content items may be presented to a userwhen the user views a content item using the digital magazine, may bepresented as a notification to the user by the digital magazine server140, or may be presented to the user through any suitable communicationchannel.

In one embodiment, the recommendation engine 235 applies various filtersto content items received from one or more sources 110 or from thecontent store 215 to efficiently provide a user with recommended contentitems. For example, the recommendation engine 235 analyzes attributes ofcontent items in view of characteristics of a user retrieved from theuser's user profile. Examples of attributes of content items include atype (e.g., image, story, link, video, audio, etc.), a source 110 fromwhich a content item was received, time when a content item wasretrieved, and subject matter of a content item. Examples ofcharacteristics of a user include biographic information about the user,users connected to the user, and interactions between the user andcontent items. In one embodiment, the recommendation engine 235 analyzesattributes of content items in view of a user's characteristics for aspecified time period to generate a set of recommended content items.The set of recommended content items may be presented to the user or maybe further analyzed based on user characteristics and on content itemattributes to generate more refined set of recommended content items. Asetting included in a user's user profile may specify a length of timethat content items are analyzed before identifying recommended contentitems to the user, allowing a user to balance refinement of recommendedcontent items with time used to identify recommended content items.

The search module 240 receives a search query from a user and retrievescontent items from one or more sources 110 based on the search query.For example, content items having at least a portion of an attributematching at least a portion search query are retrieved from one or moresources 110. The user may specify sources 110 from which content itemsare received through settings maintained by the user's user profile orby identifying one or more sources in the search query. In oneembodiment, the search module 240 generates a section of the digitalmagazine including the content items identified based on the searchquery, as the identified content items have a common attribute of theirassociation with the search query. Presenting identified content itemsidentified from a search query allows a user to more easily identifyadditional content items at least partially matching the search querywhen additional content items are provided by sources 110.

To more efficiently identify content items based on search queries, thesearch module 110 may index content items, groups (or sections) ofcontent items, and user profile information. In one embodiment, theindex includes information about various content items, such as author,source, topic, creation data/time, user interaction information,document title, or other information capable of uniquely identifying thecontent item. Search queries are compared to information maintained inthe index to identify content items for presentation to a user. Thesearch module 140 may present identified content items based on aranking. One or more factors associated with the content items may beused to generate the ranking Examples of factors include: globalpopularity of a content item among users of the digital magazine server140, connections between users interacting with a content item and theuser providing the search query, and information from a source 110.Additionally, the search module 240 may assign a weight to the indexinformation associated with each content item selected based onsimilarity between the index information and a search query and rank thecontent items based on their weights. For example, content itemsidentified based on a search query are presented in a section of thedigital magazine in an order based in part on the ranking of the contentitems.

To increase user interaction with the digital magazine, the interfacegenerator 245 maintains instructions associating received input withactions performed by the digital magazine server 140 or by a digitalmagazine application executing on a client device 130. For example,instructions maintained by the interface generator 245 associate typesof inputs or specific inputs received via an input device 132 of aclient device 130 with modifications to content presented by a digitalmagazine. As an example, if the input device 132 is a touch-sensitivedisplay, the interface generator 245 includes instructions associatingdifferent gestures with navigation through content items or presentedvia a digital magazine. Instructions from the interface generator 245are communicated to a digital magazine application or other applicationexecuting on a client device 130 on which content from the digitalmagazine server 140 is presented. Inputs received via an input device132 of the client device 130 are processed based on the instructionswhen content items are presented via the digital magazine server 140 ispresented to simplify user interaction with content presented by thedigital magazine server 140.

The web server 250 links the digital magazine server 140 via the network120 to the one or more client devices 130, as well as to the one or moresources 110. The web server 250 serves web pages, as well as othercontent, such as JAVA®, FLASH®, XML and so forth. The web server 250 mayretrieve content item from one or more sources 110. Additionally, theweb server 250 communicates instructions for generating pages of contentitems from the layout engine 220 and instructions for processingreceived input from the interface generator 245 to a client device 130for presentation to a user. The web server 250 also receives requestsfor content or other information from a client device 130 andcommunicates the request or information to components of the digitalmagazine server 140 to perform corresponding actions. Additionally, theweb server 250 may provide application programming interface (API)functionality to send data directly to native client device operatingsystems, such as IOS®, ANDROID™, WEBOS®, or BlackberryOS.

For purposes of illustration, FIG. 2 describes various functionalitiesprovided by the digital magazine server 140. However, in otherembodiments, the above-described functionality may be provided by adigital magazine application executing on a client device 130, or may beprovided by a combination of the digital magazine server 140 and adigital magazine application executing on a client device 130. Forexample, an image may be modified based on identified regions of theimage including objects or not including objects and the modified imagepresented by a digital magazine application executing on the clientdevice 130. Alternatively, information identifying slots of a pagetemplate used to generate a page of a digital magazine are communicatedfrom a client device 130 to the digital magazine server 140, whichidentifies one or more images for presentation in content regions of apage; the modified images are communicated from the digital magazineserver 140 to the client device 130 for presentation.

Page Templates

FIG. 3 illustrates an example page template 302 having multiplerectangular slots each configured to present a content item. Other pagetemplates with different configurations of slots may be used by thedigital magazine server 140 to present one or more content itemsreceived from sources 110. As described above in conjunction with FIG.2, in some embodiments, one or more slots in a page template arereserved for presentation of content items having specificcharacteristics or for presentation of a specific type of content item.In one embodiment, the size of a slot may be specified as a fixed aspectratio or using fixed dimensions. Alternatively, the size of a slot maybe flexible, where the aspect ratio or one or more dimensions of a slotis specified as a range, such as a percentage of a reference or a basedimension. Arrangement of slots within a page template may also behierarchical. For example, a page template is organized hierarchically,where an arrangement of slots may be specified for the entire pagetemplate or for one or more portions of the page template.

In the example of FIG. 3, when a digital magazine server 140 generates apage for presentation to a user, the digital magazine server 140populates slots in a page template 302 with content items. Informationidentifying the page template 302 and associations between content itemsand slots in the page template 302 is stored and used to generate thepage. For example, to present a page to a user, the layout engine 220identifies the page template 102 from the template store 210 andretrieves content items from one or more sources 110 or from the contentstore 215. The layout engine 220 generates data or instructionsassociating content items with slots within the page template 302.Hence, the generated page includes various “content regions” presentingone or more content items associated with a slot in a location specifiedby the slot.

A content region 304 may present image data, text, data, a combinationof image and text data, or any other information retrieved from acorresponding content item. For example, in FIG. 3, the content region304A represents a table of contents identifying sections of a digitalmagazine, and content associated with the various sections are presentedin content regions 304B-304H. For example, content region 304A includestext or other data indicating that the presented data is a table ofcontents, such the text “Cover Stories Featuring,” followed by one ormore identifiers associated with various sections of the digitalmagazine. In one embodiment, an identifier associated with a sectiondescribes a characteristic common to at least a threshold number ofcontent items in the section. For example, an identifier refers to thename of a user of social network from which content items included inthe section are received. As another example, an identifier associatedwith a section specifies a topic, an author, a publisher (e.g., anewspaper, a magazine) or other characteristic associated with at leasta threshold number of content items in the section. Additionally, anidentifier associated with a section may further specify content itemsselected by a user of the digital magazine server 140 and organized as asection. Content items included in a section may be related topicallyand include text and/or images related to the topic.

Sections may be further organized into subsections, with content itemsassociated with one or more subsections presented in content regions.Information describing sections or subsections, such as a characteristiccommon to content items in a section or subsection, may be stored in thecontent store 215 and associated with a user profile to simplifygeneration of a section or subsection for the user. A page templateassociated with a subsection may be identified, and slots in the pagetemplate associated with the subsection used to determine presentationof content items from the subsection relative to each other. Referringto FIG. 3, the content region 304H includes a content item associatedwith a newspaper to indicate a section including content items retrievedfrom the newspaper. When a user interacts with the content region 304, apage template associated with the section is retrieved, as well ascontent items associated with the section. Based on the page templateassociated with the section and the content items, the digital magazineserver 140 generates a page presenting the content items based on thelayout described by the slots of the page template. For example, in FIG.3, the section page 306 includes content regions 308, 310, 312presenting content items associated with the section. The contentregions 308, 310, 312 may include content items associated with varioussubsections including content items having one or more commoncharacteristics (e.g., topics, authors, etc.). Hence, a subsection mayinclude one or more subsections, allowing hierarchical organization andpresentation of content items by a digital magazine.

Identifying Regions in an Image Based on Feature Points in the Image

FIG. 4 shows a flowchart of one embodiment of a method for identifyingregions of an image based on feature points in the image. In oneembodiment, the functionality described in conjunction with FIG. 4 isperformed by the layout engine 220; however, in other embodiments, anysuitable component or combination of components may perform thefunctionality described in conjunction with FIG. 4. Additionally, insome embodiments, different and/or additional steps than thoseidentified in FIG. 4 may be performed or the steps identified in FIG. 4may be performed in different orders.

The digital magazine server 140, or an application associated with thedigital magazine server 140 and executing on a client device 110,obtains 405 one or more images from one or more sources 110 or from thecontent store 215 for presentation to a user of the digital magazineserver 140 in a digital magazine. For example, an image is obtained 404from a source 110 for display with content associated with the source110. Alternatively, an image is obtained 405 from the content store 215for presentation with text data retrieved from the content store 215.

Various feature points are identified 410 from the obtained image. Asused herein, a “feature point” in an image is a pixel or group of pixelsidentifying one or more characteristics or points of interest associatedwith an object in an image. For example, a feature point is a group ofpixels identifying an edge or boundary (a “point of interest”) of anobject in an image. In one embodiment, a feature point is identified asa pixel or group of pixels in an image having at least a thresholdchange in color across the pixel or group of pixels; therefore, in someembodiments, a feature point is identified as one or more pixels in theimage having at least a threshold change in color between a portion ofthe image adjacent to a boundary of the one or more pixels and anadditional portion of the image adjacent to another boundary of the oneor more pixels. For example, a pixel has a red-green-blue (RGB) value of87 and an additional pixel that is adjacent to the pixel has an RGBvalue of 246. In this example, a feature point is identified as a set ofadjacent pixels having at least a threshold change in RGB value of 100,so the pixel and the additional pixel are identified 410 as a featurepoint because they have a difference in RGB values of 159. However,other image processing methods may be used to identify 410 featurepoints; for example, various edge detection techniques may be used toidentify feature points along the edges or boundaries of an object inthe image. In one embodiment, feature points of the obtained image areidentified 410 by manually review of the image. In another embodiment,the source 110 from which the image is obtained 405 provides informationidentifying 410 feature points in the image along with the image.

Additionally, the digital magazine server 140 may identify additionalinformation associated with the identified feature points of the image.For example, a location or a position of identified feature points withrespect to one or more boundaries of the image, an identifier associatedwith a feature point identified 410 from the image, and displayattributes such as average color or size of an identified feature pointare identified. For example, the digital magazine server 140 identifies410 a feature point in the image and information describing the featurepoint (e.g., the location of the feature point with respect to the topleft corner of the image, and the average color of the pixels associatedwith the feature point). In one embodiment, the digital magazine server140 identifies a group of pixels associated with a feature point andstores pixel indices of pixels in the group to identify a location inthe image corresponding to the feature point.

The digital magazine server 140 partitions 415 the image into regionsthat each specify a portion of the image having dimensions specified bythe digital magazine server 140. In one embodiment, the digital magazineserver 140 partitions 415 the image into multiple regions that areequally sized. For example, the image is partitioned 415 into multipleregions that have the same dimensions. In one example, the digitalmagazine server 140 specifies the dimensions of a region based on thesize or dimensions of the image. The aspect ratio of the regions may besimilar to the aspect ratio of the image. The digital magazine server140 may determine the dimensions of a region by dividing the dimensionsof an image by a constant value. In another example, the regions arenon-overlapping geometric shapes corresponding to the applicationexecuting on the client device 130 for presenting the image aftermodification. For example, the regions may be circles for insertingcircular images into the image. In another example, the regions may bepolygons (e.g., rectangles) for inserting polygonal (e.g., rectangular)images or text into the original image. This allows the image to bepartitioned 415 into regions based on the type of content to be includedin the image after modification or based on the application displayingthe image after modification. In one embodiment, the digital magazineserver 140 does not partition 415 images having dimensions less thanthreshold values. Additionally, the digital magazine server 140 mayspecify minimum dimensions of regions. In some embodiments, the digitalmagazine server 140 also identifies additional information associatedwith the regions of the image. For example, the position of regions withrespect to one or more boundaries of the image is identified, averagecolor of the region, or other display attributes of one or more regions.In one embodiment, information describing an average color of pixels ina region and the location of the region with respect to the top leftcorner of the image is identified for various regions of the image.

A number of feature points in each region of the image are determined420 by the digital magazine server 140. In one embodiment, the digitalmagazine server 140 compares location information associated with theidentified feature points and the location information associated with aregion to determine 420 the number of feature points within the region.For example, the digital magazine server 140 identifies the pixelindices of boundaries of a region and compares the pixel indicesassociated with the boundaries of the region with pixel indicesassociated with pixels included in feature points. Feature pointsassociated with pixel indices within the boundaries of a region areidentified as feature points included in the region. Alternatively,pixel indices associated with a feature point are compared to pixelindices of pixels within a region, and a feature point associated withpixel indices matching at least a threshold number of pixel indices inthe region is identified as a feature point included in the region.Alternatively, other techniques may be used to compare the locationinformation associated with identified feature points with the locationinformation associated with a region to determine 420 the number offeature points in the region of the image. In one embodiment, thedigital magazine server 140 associates an identifier with each regionincluding at least a threshold number of feature points.

In one embodiment, the digital magazine server 140 identifies 425regions including feature points that are not adjacent to other regionsincluding feature points. Typically, an object in the image includesfeature points in multiple adjacent regions, so regions includingfeature points that are not adjacent to other regions including featurepoints are often regions including feature points that do not correspondto an object in the image. Isolated feature points are typicallyassociated with objects in the image having less than a threshold sizeor with minor changes across pixels in the image, so regions containingisolated feature points may be identified as regions of the image notincluding an object to prevent from obscuring. In one embodiment, thedigital magazine server 140 determines whether regions within athreshold number of regions from a region including at least a thresholdnumber of feature points include at least the threshold number offeature points. For example, the digital magazine server 140 determinesif regions directly adjacent to a region including at least thethreshold number of feature points include the threshold number offeature points. If regions adjacent to the region including at least thethreshold number of feature points do not include at least the thresholdnumber of feature points, the region is identified 425. In anotherexample, the digital magazine server 140 determines if regions within 2regions of a region including at least the threshold number of featurepoints include the threshold number of feature points and identifies 425the region if regions within 2 regions of the region do not include atleast the threshold number of feature points. In one embodiment, thedigital magazine server 140 associates an identifier with regionsincluding at least the threshold number of feature points that are notadjacent to other regions including at least the threshold number offeature points.

Based at least in part on the number of feature points in each region ofthe image, the digital magazine server 140 determines 430 groups ofregions of the image. In one example, the digital magazine server 140determines 430 that adjacent regions of the image each including lessthan a threshold number of feature points are included in a group.Alternatively, the digital magazine server 140 determines 430 thatadjacent regions of the image each including at least a threshold numberof feature points are included in a group. In another example, regionsincluding at least a threshold number of feature points are included ina group along with additional regions that do not include at least thethreshold number of feature points and are adjacent to the region.Alternatively, the digital magazine server 140 identifies a region ofthe image including a number of feature points and determines 430 thatadditional regions adjacent to the region and including a number offeature points within a threshold value of the number of feature pointsincluded in the region are included in a group including the region. Inone embodiment, the digital magazine server 140 determines 430 groupsincluding multiple adjacent regions of an image until a group reaches athreshold size, shape or aspect ratio. The digital magazine server 140may determine 430 groups of regions by initially identifying regions inone or more corners of an image and identifying regions adjacent to theidentified regions. A region in the image may be associated with morethan one group. For example, a region in the top left corner of theimage may be grouped with adjacent regions along the top border of theimage and grouped with adjacent regions along the left border of theimage.

The digital magazine server 140 identifies information associated with agroup. For example, information identifying the location or position ofa group within the image is stored in association with the group. Forexample, coordinates specifying boundaries of a group determinedrelative to a corner of the image are stored along with an identifier ofthe group. Additionally, an average color of pixels in a group, anaspect ratio of a group, a size of a group or other display attributesmay be associated with a group.

In one embodiment, based at least in part on the information associatedwith groups of regions of the image, the digital magazine server 140ranks 435 the groups of regions. For example, the groups of regions areranked 435 based on the aspect ratios of the groups and location of thegroups within image. As an example, a group of regions located in acorner of the image with an aspect ratio of 4:3 has a higher position ina ranking than a group of regions located towards the center of theimage with an aspect ratio of 6:1. In another example, the groups ofregions are ranked 435 based on the size or dimensions of the groups. Asanother example, the groups of regions are ranked 435 based in part on anumber of feature points included in each group. Alternatively, groupswith more than a threshold number of regions including at least athreshold number of feature points are ranked 435 separately from groupswith less than the threshold number of regions including at least thethreshold number of feature points. In one embodiment, the image,information associated with feature points in the image, informationassociated with regions of the image, information associated with groupsof regions, and the ranking of groups are stored in the content store215.

The digital magazine server 140 selects 440 one or more groups ofregions to associate with the image. In one embodiment, the groups areselected 440 based at least in part on the ranking. For example, groupshaving at least a minimum aspect ratio and including less than athreshold number of feature points are selected 440 to identify portionsof the image suitable for presenting text. The average color of a groupmay also be used when selecting 440 groups; for example, a colorassociated with text is determined and one or more groups having atleast a minimum aspect ratio, including less than a threshold number offeature points, and having an average color differing from the colorassociated with the text are selected 440. In the preceding example, thedigital magazine server 140 modifies the image by overlaying textassociated in the one or more selected groups. Overlay of text on animage is further described in U.S. patent application Ser. No.14/155,053. In another example, the digital magazine server 140 selects440 groups having less than a threshold number of feature points andmodifies the image by cropping the selected groups of regions.Alternatively, the digital magazine server 140 selects 440 groups havingat least the threshold number of feature points to indicate one or moreportions of the image to preserve when cropping the image.

In one embodiment, the digital magazine server 140 communicatesinformation identifying the selected groups to a client device 130 alongwith the image. The client device 130 may modify the image (e.g., cropportions of the image, overlay text in the image, select text forpresentation in the groups of regions of the image, etc) based at leastin part on the selected groups of regions associated with the image andthe information associated with the selected groups of regions. Forexample, the digital magazine server 140 communicates informationidentifying a location of one or more selected groups relative to aboundary of the image and an average color of each selected group to theclient device 130.

The client device 130 or the digital magazine server 140 modifies theimage based at least in part on the selected groups. For example, theimage is modified to include text in one or more of the selected groupsor is modified to remove one or more of the selected groups. In oneembodiment, the modified image is presented by the client device 130along with other content items in locations relative to each other basedon slots in a page template. For example, a page template is selectedand a slot in the page template is identified for presenting themodified image. The modified image is retrieved and presented to theuser in a location and a size determined from the identified slot.

Example Identification of Regions in an Image

FIGS. 5a-5e illustrate an example of identifying, grouping and selectingregions of an image. In FIG. 5a , an image 505 includes a person 506 andbackground content. In the example of FIG. 5a , the digital magazineserver 140 identifies feature points 510 a, 510 b, 510 c, 510 d, 510 e,510 f, 510 g, 510 h, 510 i, 510 j, 510 k, and 510 l (also referred toindividually and collectively using reference number 510) in the image505. As described above in conjunction with FIG. 4, the feature points510 may be identified based on a color difference between adjacentpixels or based on any other suitable criteria. In the example of FIG.5a , the feature points 510 identify a boundary between the person 506and the background content of the image 505.

In FIG. 5b , the image 505 is partitioned into one or more equally-sizedregions represented by columns 520, 521, 522, 523, 524, and 525 and rowsa, b, c, d, e, and f. The digital magazine server 140 determines thenumber of feature points 510 in each region of the image. For example,the digital magazine server 140 determines that region 523 b includes 2feature points 510, feature point 510 b and feature point 510 c, asdescribed above in conjunction with FIG. 4. The digital magazine server140 also identifies regions of the image including at least a thresholdnumber of feature points but not adjacent to another region including atleast the threshold number of feature points. For example, if thethreshold number of feature points is 1, the digital magazine server 140identifies region 525 f as a region including a feature point 510 l thatis not adjacent to another region of the image including a feature point510.

In FIG. 5c , the digital magazine server 140 generates groups includingone or more adjacent regions of the image 505. In one embodiment, thedigital magazine server 140 generates groups based on the number offeature points in adjacent regions. For example, in FIG. 5c regions 521c, 522 b-f, 523 b-f and 524 d are grouped together as they are adjacentregions including at least one feature point 510. In another example,the digital magazine server 140 groups one or more regions includingless than the threshold number of feature points 510; FIG. 5cillustrates groups of regions including less than a threshold number ofone feature point 510 using shading. For example, the digital magazineserver 140 generates a group including regions 520 a-b, 521 a-b, and 522a and another group including regions 520 a-b and 521 a-b. In oneembodiment, the digital magazine server 140 ranks the groups of regionsbased at least in part on the aspect ratio, size, location and theaverage color of the groups of regions, as described in conjunction withFIG. 4. In another embodiment, the digital magazine server 140 generatesgroups corresponding to an application that displays the modified imageor based on types of content to be included in a modified image. Forexample, groups may be polygons comprised of connected rectangular ortriangular regions for inserting images, text, or other content havingboundaries corresponding to the shape of the polygons into the image505.

FIG. 5d shows an example of the digital magazine server 140 selectingone or more groups of regions based at least in part on the ranking ofgroups. In the example of FIG. 5d , the digital magazine server selectsgroups 540 a, 540 b, 540 c, and 540 d (also referred to individually andcollectively using reference number 540) as groups of regions associatedwith the image. In one embodiment, the selected groups identify regionsof the image free of objects. In one example, the image 505, informationassociated with feature points 510 in the image 505, informationassociated with the selected groups 540 and the selected groups 540 arestored in the content store 130. In another example, the digitalmagazine server 140 modifies the image 505 for presentation to the userof the digital magazine server 140 by overlaying text associated withthe image 505 in one or more of the selected groups 540. As anotherexample, the digital magazine server 140 sends information associatedwith the selected groups 540 with the image 505 to the client device130, allowing the client device 130 to modify the image 505 based on theselected groups 540.

In FIG. 5e the digital magazine server 140 identifies groups thatcorrespond to regions of the image including the object. In the exampleof FIG. 5e , the digital magazine server 140 selects group 550 as agroup of regions based at least in part on the number of feature pointsin regions included in each region in the group 550, as described inconjunction with FIG. 4. In one embodiment, the digital magazine server140 identifies the group of regions 550 as regions not to be croppedwhile resizing or modifying the image 505. Alternatively, informationassociated with the groups of regions adjacent to group 550, denoted byshading in FIG. 5e , may be associated with the image 505 to identifyregions capable of being cropped when modifying the image 505. In oneembodiment, information associated with the image 505, informationassociated with group 550, or information associated with the adjacentgroups to group 550 are stored in the content store 215 or sent with theimage 505 to the client device 130.

SUMMARY

The foregoing description of the embodiments of the invention has beenpresented for the purpose of illustration; it is not intended to beexhaustive or to limit the invention to the precise forms disclosed.Persons skilled in the relevant art can appreciate that manymodifications and variations are possible in light of the abovedisclosure.

Some portions of this description describe the embodiments of theinvention in terms of algorithms and symbolic representations ofoperations on information. These algorithmic descriptions andrepresentations are commonly used by those skilled in the dataprocessing arts to convey the substance of their work effectively toothers skilled in the art. These operations, while describedfunctionally, computationally, or logically, are understood to beimplemented by computer programs or equivalent electrical circuits,microcode, or the like. Furthermore, it has also proven convenient attimes, to refer to these arrangements of operations as modules, withoutloss of generality. The described operations and their associatedmodules may be embodied in software, firmware, hardware, or anycombinations thereof.

Any of the steps, operations, or processes described herein may beperformed or implemented with one or more hardware or software modules,alone or in combination with other devices. In one embodiment, asoftware module is implemented with a computer program productcomprising a computer-readable medium containing computer program code,which can be executed by a computer processor for performing any or allof the steps, operations, or processes described.

Embodiments of the invention may also relate to an apparatus forperforming the operations herein. This apparatus may be speciallyconstructed for the required purposes, and/or it may comprise ageneral-purpose computing device selectively activated or reconfiguredby a computer program stored in the computer. Such a computer programmay be stored in a non-transitory, tangible computer readable storagemedium, or any type of media suitable for storing electronicinstructions, which may be coupled to a computer system bus.Furthermore, any computing systems referred to in the specification mayinclude a single processor or may be architectures employing multipleprocessor designs for increased computing capability.

Embodiments of the invention may also relate to a product that isproduced by a computing process described herein. Such a product maycomprise information resulting from a computing process, where theinformation is stored on a non-transitory, tangible computer readablestorage medium and may include any embodiment of a computer programproduct or other data combination described herein.

Finally, the language used in the specification has been principallyselected for readability and instructional purposes, and it may not havebeen selected to delineate or circumscribe the inventive subject matter.It is therefore intended that the scope of the invention be limited notby this detailed description, but rather by any claims that issue on anapplication based hereon. Accordingly, the disclosure of the embodimentsof the invention is intended to be illustrative, but not limiting, ofthe scope of the invention, which is set forth in the following claims.

What is claimed is:
 1. A method comprising: obtaining an image forpresentation to a user of a digital magazine; identifying one or morefeature points in the image, each feature point identifying a point ofinterest associated with an object in the image; partitioning the imageinto a plurality of equally-sized regions; determining a number offeature points in each region of the image; determining one or moregroups of adjacent regions based at least in part on the number offeature points in each region, each group including a plurality ofregions adjacent to each other, by identifying a region in the image;identifying regions adjacent to the identified region including at leasta threshold number of feature points; and generating a group of regionsincluding the identified region and the regions adjacent to theidentified region including at least the threshold number of featurepoints; and identifying regions of the image including feature pointsthat are not adjacent to at least one other region including featurepoints; storing information identifying the one or more groups ofregions in association with the image.
 2. The method of claim 1, whereinidentifying one or more feature points in the image comprises:identifying one or more pixels in the image having at least a thresholdchange in color between a color associated with portion of the imageadjacent to a boundary of the one or more pixels and an additional colorassociated with an additional portion of the image adjacent to anotherboundary of the one or more pixels.
 3. The method of claim 1, whereinidentifying one or more feature points in the image comprises:identifying one or more pixels associated with an edge of an object inthe image.
 4. The method of claim 1, wherein partitioning the image intothe plurality of equally sized regions comprises: identifying dimensionsof the image; determining whether the dimensions of the image aregreater than a threshold value; and responsive to determining thedimensions of the image are greater than threshold value, partitioningthe image into a plurality of equally sized regions based at least inpart on the dimensions of the image.
 5. The method of claim 1, whereindetermining the number of feature points in each region of the imagecomprises: identifying location information associated with each featurepoint in the image; identifying location information associated witheach region in the image; and identifying a number of feature points ina region of the image based on feature points associated with locationinformation included within location information associated with theregion.
 6. The method of claim 1, wherein determining one or more groupsof regions based on the number of feature points in each regioncomprises: identifying dimension information associated with each group;and ranking the determined groups based at least in part on thedimension information associated with each group.
 7. The method of claim6, wherein determining the one or more groups is based at least in parton dimension information associated with the one or more groups.
 8. Amethod comprising: obtaining an image for presentation to a user of adigital magazine; identifying one or more feature points in the image,each feature point identifying a point of interest associated with anobject in the image; partitioning the image into a plurality of equallysized regions; determining a number of feature points in each region ofthe image; determining one or more groups of regions based at least inpart on the number of feature points in each region, each groupincluding a plurality of adjacent regions, by identifying a region inthe image; identifying regions adjacent to the identified regionincluding at least a threshold number of feature points; and generatinga group of regions including the identified region and the regionsadjacent to the identified region including at least the thresholdnumber of feature points; identifying regions of the image includingfeature points that are not adjacent to at least one other regionincluding feature points; selecting text for presentation along with theimage; selecting one or more of the groups of regions for presenting theselected text, the selected one or more groups of regions including lessthan a threshold number of feature points; and modifying the image topresent the selected text in the one or more selected groups of regions.9. The method of claim 8, wherein identifying one or more feature pointsin the image comprises: identifying one or more pixels in the imagehaving at least a threshold change in color between a color associatedwith portion of the image adjacent to a boundary of the one or morepixels and an additional color associated with an additional portion ofthe image adjacent to another boundary of the one or more pixels. 10.The method of claim 8, wherein identifying one or more feature points inthe image comprises: identifying one or more pixels associated with anedge of an object in the image.
 11. The method of claim 8, wherein theregions are rectangular and selecting one or more of the groups ofregions for presenting the selected text comprises: determining a heightand a width of each of the determined group of regions; ranking thedetermined groups of regions based at least in part on the determinedheights and widths; and selecting one or more ranked groups of regionsfor presenting the selected text based at least in part on the ranking.12. The method of claim 8, further comprising: determining an averagecolor associated with each of the selected group of regions; andselecting a portion of the selected text for presentation in one or moreof the selected groups of regions based at least in part on thedetermined average colors and colors associated with the portions of theselected text.